LARGE TIME BEHAVIOR OF WEAKLY COUPLED SYSTEMS OF 
FIRST-ORDER HAMILTON- J ACOBI EQUATIONS 



FABIO CAMILLI, OLIVIER LEY, PAOLA LORETI AND VINH DUC NGUYEN 

Abstract. We show a large time behavior result for class of weakly coupled systems of 
first-order Hamilton- Jacobi equations in the periodic setting. We use a PDE approach to 
extend the convergence result proved by Namah and Roquejoffre (1999) in the scalar case. 
Our proof is based on new comparison, existence and regularity results for systems. An 
interpretation of the solution of the system in terms of an optimal control problem with 
switching is given. 



1. INTRODUCTION 

The aim of this paper is to study the large time behavior of the system of Hamilton- 
Jacobi equations 

Ou m 
, . . , -^ + H i (x,Du i )+J2d ij (x)u j = (x,t) G T N x (0,+oo), . 
T.l) { dt ~t i = l,. ..,m, 

Ui{x, 0) = u 0i (x) x G T^, 

where is the N- dimensional torus. The Hamiltonians Hi(x,p) are of eikonal type and 
the coupling is linear and monotone, i.e., 

m 

(1.2) du(x) > 0, d i:j (x) < for i ^ j and d^x) > 0, for all x G T N . 

The corresponding problem for the Hamilton- Jacobi equation 

(1.3) ^ + H (x,Du)=0 

has been extensively investigated using both PDE methods, see Namah and Roquejoffre 
|25j . Barles and Souganidis [1], and a dynamical approach: Fathi [HI [12], Roquejoffre [26], 
Davini and Siconolfi [9J. Some of these results have been also extended beyond the periodic 
setting: Barles and Roquejoffre [3j, Ishii [18], Ichihara and Ishii [15] and for problems with 
periodic boundary conditions: see for instance Mitake [2U E21 123] • We refer also the readers 
to Ishii [T71 HH] for an overview. 
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In these works, one of the main result is that there exists a constant c G R, the so-called 
critical value or ergodic constant, and a solution v of the stationary equation 

(1.4) H(x,Du) = c 
such that 

(1.5) u(x, t) + ct — ► v(x) uniformly as t — > +oo. 

There are several equivalent characterizations of the critical value (see [12]), for example 
c is the unique constant such that 

u (x, t ) 

(1.6) > —c uniformly as t — > +oo, 

t 

or 

(1.7) c = min{a G R : H(x, Du) = a has a subsolution}. 

While c is uniquely determined, the main difficulty in proving a result like (jl.5p is that (11. 4p 
does not admit a unique solution (at least, the equation is invariant by addition of con- 
stants). 

To our knowledge, there are not only no results of asymptotic type for the system (11.11) . 
but also the study of corresponding ergodic problem 

rn 

(1.8) Hi(x,Dvi(x)) +J2 d iA x ) v j( x ) = d x ^ tJV > 

3=1 

is not well understood (see [8] for some preliminary results). 

With the aim of understanding if some convergence like ( 11.51) holds in the case of systems, 
we focus on the setting of Namah and Roquejoffre [25] . Let us start by recalling the main 
result of [25J. It takes place in the periodic setting and they assume that H in (II. 3ft is 
continuous and of the type 

H(x, p) = F(x, p) - f(x) x G T N ,p G R^, 

where F is coercive and convex with respect to p. Besides, F(x,p) > F(x,0) = 0. The 
function / is continuous and satisfies 

(1.9) / > and j; calar = {xeT N : f(x) = 0} ^ 0. 

It is simple to see by the characterization in (I1.7P that c = 0. Moreover by classical results 
in viscosity solution theory, J^caiar is a uniqueness set for (11.41) . i.e. the solution of (ll.4p 
is uniquely characterized by its value on this set. The coercitivity of the Hamiltonian 
provides the compactness of the functions u(-,t) for t > 0. Then employing the semi- 
relaxed limits, one can pass to the limit and obtain the convergence result if one can prove 
the convergence of u(-,t) on the set J-'scaiar- This latter result follows from the observation 
that, since F(x,p) > 0, a solution of (11.31) satisfies 

du 

— < On Scalar X (0, +Oo). 

at 
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Hence u(-,t) is nonincreasing and therefore converges uniformly on J-" sca i ar and one concludes 
that it converges in all T N . 

Our purpose is to reproduce the previous proof and therefore we assume that the Hamil- 
tonians H^s in (jl.ip are as in (25] and the coupling matrix D(x) = (rfy)i<i,i<m satis- 
fies (II. 2p . Under these assumptions, (II. ip has a unique viscosity solution in x [0, +oo) 
for any continuous initial data Mo : ^ N ~~ >" 

For the simplicity of the exposition in this introduction, we assume moreover that 

m m 

(1.10) ^2d i:j (x) = 0, z = l,...,m, ^dij(x) = 0, j = 1, . . . ,m, 

j=i i=i 

for x G T^. Note that this assumption is not necessary. We can avoid it by using the 
results of Section [2j 

To continue, we have to understand what plays the role of J-^caiar in (H-^P for systems. 
In the scalar case, there are important interpretations of the convergence (jl.5p in terms of 
dynamical systems or optimal control theory [12] . Indeed, (II. 5p means that the optimal 
trajectories of the related control problem are attracted by the set J^iar where the running 
cost / is 0. 

In the case of systems, the solutions w^'s of (II. ip are value functions of a piecewise de- 
terministic optimal control problem with random switchings. The switchings are governed 
by a continuous in time Markov process with state space {1, . . . , m} and probability tran- 
sitions from the mode i to j given by 7^ = —dij for i ^ j. See Section [6] for further details. 
A natural assumption to obtain the convergence of the value functions u^s is to require 
that all the running costs /j's vanish at least at some common point. It suggests that the 
optimal strategy consists in driving the trajectories to such a point where the running costs 
are whatever the switchings will be (note that the coercivity of the Hamiltonian implies 
the controllability of the trajectories). So we introduce and assume that 

m m 

(1.11) T := f]{x G T N : /,(*) = 0} = {x G : £ = 0} ^ 

i=l i=l 

(recall that the f\ > 0). We need an additional assumption on the coupling matrix, namely 
that D(x) is irreducible, see Definition 12.11 Roughly speaking, it means that the coupling 
is not trivial and the system cannot be reduced to several subsystems of lower dimensions. 

The next step is to understand well the limit problem ( |l.8jl . Under the previous assump- 
tions, J 7 appears to be a uniqueness set for the stationary system (II ,8p with q = (as 
in [22], we will prove that our assumptions imply that the critical value is c = 0). More 
precisely, on this set it is sufficient to control the value of the sum v\ + ■ ■ • + v m of a solution 
to fll.8p . see Theorem 13. 3| a condition which seems to be new with respect to standard 
assumptions on weakly coupled systems ([10], [20]). Let us mention that, when (ll.lOp does 
not hold, we need to replace T with another set A, see (I3.6p - (l3.7p . 
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We then solve the so-called ergodic problem, which consists in finding a couple (c, v) G 
M m x C{T N \W n ) of solutions to f ll.Sp . The motivation comes from the formal expansion 
suggested by the convergence result of type (11. 5ft we are expecting for (II. lj) . Plugging 
Uoo(x) — ct ps u(x,t) in ( jl.ip . we obtain that (c, Woo) should be a solution of 



ifi(x, -D(Moo)i) + 2jd i3 -(a;)('U 00 )j-(a:) - t^Jd^x)^ = q, 

for all i, with c G ker(D(x)) to cancel the term in t. In Theorem \A.2\ we prove the existence 
of a solution where c G ker(Z)(x)) and v Lipschitz continuous on T . The Lipschitz continu- 
ity of v is an easy consequence of the coercivity of the F^s. Under the assumptions (jl.lOp . 
it is easy to see that ker(D(x)) reduces to the line spanned by (1, . . . , 1) so c = (ci, . . . , ci). 
Moreover, due to (ll.lip . we obtain that c = (0, . . . , 0) is uniquely determined. 

At this step, it is worth noticing that we can solve the ergodic problem in a more general 
setting (see Theorem 14.31) . in particular without assuming (II. lip . We obtain the following 
condition on c, 

m m 

c = (ci, . . . ,ci) and V"min/j(x) < -c x < min Y]fi{x). 

i=l i=l 

This gives again an indication that assuming J 7 ^ is a first natural case to consider, 
since, in this case, inequalities are replaced with equalities in the above formula and the 
ergodic constant is univocally defined. 

We are now in force to consider the large time result (Theorem l5.4p . The coercivity of the 
Hamiltonians and the existence of a solution to the ergodic problem give the compactness 
of the sequences «j's in W 1,00 (T N x [0, +oo)). An easy consequence is the convergence (II. 6p 
for all i to (since c = in our case). To mimic the proof of [25], we need to prove the 
convergence of the Wj's on J 7 . This is the most difficult part of the work. 

Indeed, by summing the equations (11.11) for i = 1, . . . , m, we obtain 

m q m m 

(i.i2) E ^ + E H ^ Du ^ + E d ^ = °- 

i=l i=l «J=1 



Using that Hi(x, Duj) > on J and (ll.lOp . we obtain easily that 

d_ 

dt 



d m 

;i.l3) — ^Mi(a;,*)<0 onj 



i=i 



and therefore t (-> (u\ + - ■ - + u m )(-,t) is nonincreasing and converges uniformly as t — > +oo 
on J 7 . But this is not enough to prove the convergence of each Ui on J 7 . 

To overcome this difficulty, we use some ideas of We choose a subsequence t n — > 
+oo such that u(-,t n + •) converges uniformly to some w(-, •) in W 1 '°°(T N x [0, +oo)). By 
stability of the viscosity solutions, w is still solution of (II. ip and we earn something: now, 
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t i — y (wi + ■ ■ ■ + w m )(-,t) is constant on F . Therefore (11 . 13[) holds for the WiS with an 
equality. It follows from (I1.12p that 

m 

2J Hi(x, Dwi) = on F x (0, +00). 

i=l 

Since Hi = Fi > on F, we infer that Hi(x, Dwi) = for all 1 < i < m. Therefore, the 
system (II. ip reduces to a linear differential system 

dw 

— (x,t) + D(x)w(x,t) = t>0, 
at 

for every x G F. Using that D{x) satisfies (II. 2p . (11.101) and is irreducible, we can prove the 
convergence of each Wi(-,t) on F and then on by applying the comparison Theorem 13.31 
The conclusion follows by proving that u(-,t) converges to the same limit as w(-,t). 

The paper is organized as follows. In Section [2], we study some properties of the cou- 
pling matrix D without assumption ( 11.101) . Section [3] is devoted to study existence and 
uniqueness of the stationary problem. In Section H] we solved the ergodic problem. The 
convergence result is proved in Section Finally, in Section [HI we give a control theoretic 
interpretation of the problem. 

We learnt recently that Mitake and Tran |24J studied systems of two equations (m = 2) 
both in our setting (see Remark 15.71 (3)) and also in some particular cases related to [1]. 

Notation. If p = (pi, . . . ,p m ) is a vector in R m , then p > (respectively p > 0) means 
that pi > (respectively Pi > 0) for 1 < i < m. 

Acknowledgments. O.L. is partially supported by the project ANR BLANC07-3 187245, 
"Hamilton- Jacobi and Weak KAM Theory". We would like to thank G. Barles and 
P. Cardaliaguet who helped us to improve the first version of this work and M. Briane, 
L. Herve and J. Ledoux for useful references and suggestions. 

2. Preliminaries on coupling matrices 

We consider the matrix D(x) = {dij(x))i<ij< m and call it a coupling matrix for the 
systems (II .ip and (jl.8p . We assume that the coupling matrices satisfy the following 
standard assumptions (see [IS], [2"U] ) 

(2.1) 



dij : T — > R are continuous and, for all x e T , 



da(x) > 0, dij(x) < for i 7^ j and ^^rfjj(x) > 0. 

3=1 

We introduce some conditions on the matrix D we will be interested in: 

Definition 2.1. We say that D is 
(i) a M-matrix if 

D = si — B, for some s > 0, B = (bij)i<ij< m , > 0, 
with s > p{B) and p{B) the spectral radius of B, 
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(/ is the identity matrix). 
(ii) irreducible if, for all subset X Ci {1, 
that dij 7^ 0. 



, m} then there exists i G X and j G" X such 
Lemma 2.2. If D satisfies ( 12.ip . i/ien it a M -matrix for any x. 



Proof. If D = 0, there is nothing to prove. Otherwise, s := m.&yLi<k<m,dkk > 0. Then, we 
can write D = si — B with B = with 6^ = s — da and 6^- = — for i 7^ j. Since B > 0, 
by Perron-Froebenius theorem, the spectral radius p(-B) of .B is an eigenvalue and there 
exists a nonnegative eigenvector p such that Bp = p(B)p. Therefore Dp = (s — p(B))p. 
Let pk = maxj^j. Since B 7^ 0, we have P/t > and, using that d^ < for i 7^ j, 



< 4j Pfc < 4jPj = {s- p{B))p k 



3=1 



and we conclude that s > p(B). 

Let us give a characterization of an irreducible matrix. 



□ 



Lemma 2.3. D is irreducible if and only if: for all i,j G {1, • ■ ■ , m}, there exists n £ N 
and a sequence i = i, i\, i 2 , ■ ■ ■ , i n — j such that d il lit 7^ for all 1 < I < n (in this case 
we say that there exists a chain between i and j). 

Proof. Let i G {1, • • • , m} and Z, be the subset of {1, ■ • • , m} containing all the chains 
starting from i. It is obvious that, if D is irreducible, then Xj = {1, ■ ■ • , m}. Conversely, let 
Z £ {1, • • • , m}, i El and j G" X. By assumption, there exists a chain i = i, ii, ■ • • ,i n = j 
between i and j. Let 1 < I < n be the smallest I such that I (jL X. Then di r _ 1 i r 7^ 0. □ 

Example 2.4. If d^ 7^ for all i,j then it is obvious that D is irreducible. In particular, 
when D satisfies ( 12. ip and, in addition, d^ < for i 7^ j, then it is irreducible. The 
matrices 

"1 -1 

and 







1 




a —a 

-a (3 



-1 1 

are irreducible and satisfy (12. ip . On the contrary, 



with a, f3 > 



(2.2) 



1 


-1 








-1 


1 














1 


-1 








-1 


1 



and 




-1 1 



satisfy ( 12. ip but are not irreducible. 

Remark 2.5. For M- matrices and irreducible M- matrices, see [51 Chapter 6] and 
These assumptions are natural when studying coupled systems of partial differential equa- 
tions like (13. ip and (15. ip . To expect some maximum principles, one usually needs M- 
matrices and, roughly speaking, when the coupling matrix is irreducible, it means that the 



LARGE TIME BEHAVIOR OF WEAKLY COUPLED SYSTEMS 



7 



equations are coupled in a non trivial way. For instance, in the cases ( I2.2p . the system of 
equations is decoupled (into two subsets of equations) and is triangular, respectively We 
refer to the work of Busca and Sirakov [6] and the references therein for details. 

Lemma 2.6. Let E\,E 2 C be closed subsets, let E = E\ R E2, suppose that D(x) = 
(dij(x))i<ij< m is such that ( 12. ip holds and 

in 

(2.3) dij(x) = for x G E\, i = 1, . . . , m. 

(2.4) D(x) is irreducible for x G E 2 , 

(i) For all x G E, D(x) is degenerate of rank m — 1, ker(D(x)) = span{(l, • • • , 1)} 
and the real part of each nonzero complex eigenvalue of D(x) is positive. Moreover 
there exists a positive continuous function A = (Ai, . . . , A m ) : E — > R m such that 
A(x) > and D(x) T A(x) = for all x G E. 

m 

(ii) In the set E2 \E±, where one only has \^dij(x) > 0, then there exists a positive 

i=i 

continuous function A = (A 1; . . . , A m ) : E 2 \ E 1 — >■ M. m such that A(x) > and 
D(x) T A(x) > for all x eE 2 \E 1 . 

Proof, (i) At first, we fix any x G E (this part of the proof comes from [5j p. 156]). 
From ( 12. 3p . (1, ■ • • , 1) G ker(D(x)). From Lemma 12.21 and (12.41) . D(x) is a nonzero M- 
matrix so we can write D(x) = s(x)I — B(x), s(x) > 0, s(x) > p(B(x)) and B(x) > 0. 
It is obvious that, if D(x) is irreducible, then so is B(x). By Perron- Froebenius theo- 
rem, it follows that p(B(x)) is a simple eigenvalue of B(x). Since, D(x)(l, • • ■ , 1) = = 
s(x)(l, •••,!) — B(x)(l, • ■ ■ , 1), we have s(x) = p(B(x)) and is a simple eigenvalue of 
D(x). Thus D(x) has rank m — 1. Besides, if A G C \ {0} is another eigenvalue of D(x), 
then s(x) — A is an eigenvalue of B(x). It follows that \s(x) — A| < p(B(x)) = s(x) and, 
since A 7^ 0, the real part of A must be positive. 

Since B T (x) is also an irreducible nonnegative matrix with p(B(x)) = p(B T (x)), using 
again Perron- Froebenius theorem, we obtain the existence of an eigenvector A(x) > such 
that B T (x)A(x) = p(B(x))A(x). Therefore D T (x)A(x) = 0. 

Then, we shall prove that it is possible to choose A(x) continuously. Let com(_D(x)) be 
the cofactor matrix of D(x). Since D(x) is non invertible, we have D(x) T com(D(x)) = 0. 
Therefore the columns Cj(x), j = 1, . . . , m, of com(D(x)) are in the kernel of D(x) T . From 
the first part of the proof, we obtain that there exist functions Aj : E — > R such that 
Cj(x) = \j(x)A(x). Define |Cj|(x) as the absolute value of the coefficients of Cj(x) and 

m / m \ 

A(x) = ^\C j \(x)=[^\\ j (x)\\A(x). 
j=i \j=i J 

On one hand, A(x) > since com(D(x)) is not 0. On the other hand, the continuity of the 
coefficients of D(x) implies the continuity of the coefficients of com(D(x)) and therefore 
the maps x 1— > \Cj\(x) are continuous on E. We conclude that A is continuous. 
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(ii) The proof is an easy consequence of (i). Define ati(x) := Y^T=i dij{ x ) — 0; the diagonal 
matrix A(x) := diag(ai(x), • • • , a m (x)) and D :— D — A. It is straightforward that D 
is still an irreducible M-matrix such that (12. 3p holds on E 2 \ E\. By (i), there exists 
a continuous A : E 2 \ E 1 -)■ R m such that A(x) > and D(x) T A(x) = 0. It follows 
D(x) T A(x) = A(x) T A(x) > by assumption. It completes the proof. □ 

3. Comparison, existence and regularity for the stationary system 
In this section we study existence and uniqueness of the solution to the stationary system 

in 

(3.1) Hi(x, Dm) + dij(x)ui = in T^, 1 < % < m, 

i=i 

where Hi : x M, N — > R, i = 1, . . . , m, is a continuous function which takes the form 

(3.2) Hi{x,p) = Fi(x,p)-fi(x). 
We assume that, for all i = 1, ■ ■ • , m, 

(3.3) fi, Fi(-,p) are continuous 1-periodic for any p G M. N ; 

(3.4) Fi(x, •) is convex, coercive and, for any x G T N , p G E , Fi{x,p) > Fi(x, 0) = ; 

(3.5) fi(x)>0. 

We set for i — 1, . . . , m, 

(3.6) F = {xeT N : YZi fi(x) = 0}, T>i = {x <E T N : £™ =1 d^x) = 0} 

(3.7) A = Tn{T£ =1 v i ). 

Remark 3.1. Note that, under (I3.5p . if F is not empty, it means that all the /j's achieve 
a common minimum at some common point. 

We recall the definition of viscosity solutions for the system (13. ip (see [TB], [2U] for more 
details about systems of Hamilton- Jacobi equations). Let USC (respectively LSC) denotes 
the upper-semicontinuous (respectively lower-semicontinuous) functions. 

Definition 3.2. 

(i) An USC function u : Mr — > lR m is said a viscosity subsolution of fl3.ll) if whenever 
G C 1 , i G {1, . . . , m} and Uj — attains a local maximum at x, then 

m 

i/ i (x, J D0(x)) + ^c/ ij ( ) < 0. 

i=i 

(ii) A LSC it : — > M. m is said a viscosity supersolution of (13. ip if whenever G C 1 , 
j G {1,..., m} and Mj — attains a local minimum at x, then 

m 

Zty(a;)) + dij(x)uj{x) > 0. 
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(iii) A continuous function u is said a viscosity solution of (13. ip if it is both a viscosity sub- 
and supersolution of (13.11) . 

We first prove a comparison theorem for (13.11) giving a boundary condition on the set 
(13. 7p . which turns out to be a uniqueness set for the system. 

Theorem 3.3. Assume fl2HD and (13T3|) - fl33|) . Le£ u G USC(T n ) and v G LSC(T N ) 6e 
respectively a bounded subsolution and a bounded supersolution of ( 13. 1 1) and suppose that 
one of the following set of assumptions holds: 

(i) Classical case: 

m 

(3.8) d iA x ) > m /° r alll<i<m. 

3=1 

(ii) Degenerate case: Assume ( 12. 4p holds with E 2 = T N and there exists 

rn 

(3.9) A : A -»■ M m , A > 0, ^ A; > 0, snc/i tfia* 

i=i 

m m 

(3.10) Y K{x)ui{x) < y^Aj(x)vi(x), x G A. 
TTien 

u < v in T N . 

Proof. The proof of the classical case can be deduced from the lines of the degenerate case, 
so we skip it and turn to the degenerate case. See some comments at the end of Case 2 
below. 

Let < fi < 1, and consider 

(3.11) sup sup {/iu k - v k } =: M M . 

l<k<m 

We assume that M M > (otherwise, there is nothing to prove). By compactness, the above 
maximum is achieved for some k at some x G T N . We set 

T= {k G {1, • • • ,m} : (fiu k - v k ){x ) = M M }. 

We distinguish 3 cases. 

Case 1: X = {1, • • • , m} and x G A. For all k, we get 

mm m m 

^A fe (x )M M = ^ A k (x ) (fj,Uk-Vk) Qeq) < (/i-1) ^ A fe (x )wfc(a;o) < (1— yu) ^ A fc (x )|^| oc 
fc=i fc=i fe=i it=i 

and therefore M M < (1 — fj,)\v |oo. 

Case 2: I = {1, • • • , m} 6iti a;o ^ A One can find i G {1, . . . , m} such that 

m 

(3.12) either /i(x ) > or ^^(iq) > 0. 
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Consider 

\x y\'^ 

sup {/jUi(x) - Vi(y) — \x-x \ 2 }. 

T Ar xT iv Ze 

The latter maximum is greater than and is achieved at some (x, y) which satisfy the 
following classical properties: 

\x y\'^ 

(3.13) x, y— > xq and — — - — , \x — xq\ 2 — >0 as e — > 0. 



We set p e 



2e 2 

x-y 



€ 2 



Writing that Ui is a viscosity subsolution of (13. ip . we have 

p _)_ 2(x — x ) m 

(3.14) V>Fi(x, — — ) + ^ dij(x)/iUj(x) < nfi(x) 

V 3=1 

and writing that Vi is a supersolution of (13. ip . we get 

m 

Fi(y,Pe) +^2d ij (y)v j (y) > fi(y). 
j=i 

From the coercivity of Fi and the boundedness of fi and the di/s on T N , (I3.14p implies 
that 

(3.15) p e <C = C{F h D,f i ). 
We subtract the two inequalities. At first 

p e + 2(x-X ), 771 / — \ „/_ Pe + 2(x-x ) 

nFi{x, ) - Fi(y,p e ) = fJLFi[x, ) - F t (x,p £ ) 

+Fi(x,p e ) - Fi(y,p e ). 

By convexity of Fi, we have 

„, p t + 2(x — xo). „. . , . „. 2{x — Xn) . , . „. 

»Fi(x,£ > — ) — Fi(x,p e ) > — (1 — fj)Fi(x, — — ) — > —(1 — p)Fi(xo, 0) = 

by (13 .4p . On the other hand, using (I3.13P and the uniform continuity of Fi on the compact 
subset x B(0, C), where C is given by ( 13 . 1 5j) . we have 

\Fi(x,p e )-Fi(y,p e )\ <o e (l) 

where o e (l) — » as e — > 0. Moreover 

m mm 

^2dij(x)fiUj(x) - dijffivjtfj) = ^diji^i/Mjix) - Vj(y)) + ^(g^-(x) - cfy(y))u,(f/) 

j=l j=l 3=1 

and 

^(dy(s) - dij(y))vj(y) — ^0 
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since v j are bounded and dij is continuous. Finally, we obtain 

m 

(3.16) ^dij^i/Mijix) - Vj(y)) <(ji- l)fi(x) + o e (l). 
3=1 

Since fiuj — Vj is U SC, for all j, 

(3.17) limswp(fiUj(x) — Vj(y)) < fiUj(xo) — Vj(xo) < M^. 

e->-0 

Recalling that dy < for j ^ i, it follows 

(3.18) dijfflbm^x) - Vj(y)) > d^ffiM^ + o e (l) for j 7^ i 
Moreover, since % G X, we have fiiii(x) — Vi(y) > and 

dii(x)(nui(x) - Vi(y)) > dii(x)M M . 

From (I3.16p . we get 

(3.19) ^ M M < (/i - + o e {\) 

which leads to a contradiction from e small enough since M M > and, by (13.121) . either 
YJj=idij{xo) > or fi(x ) > 0. 

The proof of the theorem in the classical case reduces to Case 2. Indeed, in the classical 
case, T = and, regardless X = {1, • • -m} or not, we can always choose i G X in order 
that (13. 121) holds. Notice that we do not need (13.51) . It suffices to send e — >• and fi — > 1 
in ( 13391) . 

Case 5: X 7^ {1, ■ • • m}. Using that D(xq) is irreducible, there exist i G X and fc G" X such 
that d ik (xo) < 0. We argue as in Case 2 to obtain (13.161) . Inequalities (I3.17P and ( 13 . 1 8[) 
hold true in this case too. But we need a more precise estimate for the index k. Since 
k G'X, 

(3.20) limsup(/zw£;(x) — Vk{y)) < /iWfc(xo) — Vk(xo) < M M — r\ for some r\ > 0. 

e->0 

From (I3TT6|) . (l3~T7j) . (1318]) and (13T20|) . we obtain 

d«(x)M„ + dijix^M^ + d iJk (x)(M M - 77) < (/x - + o e (l). 

It follows 

-d ik (xo)r] < ^yZdjj(x)j M M - d ik (x )r] < (// - + o e (l) < o e (l) 

which leads to a contradiction for small e since d^x®) < 0. 

.End of the proof. The only possible case is M M < (1 — //)|i>|oo which implies that M\ < 0. 
The proof is complete. □ 
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Remark 3.4. The classical case (I3.8P corresponds to the scalar case Am + H (x, Du) = 
with A > and, in this case, we always have existence and uniqueness of the solution. 
Theorem 13.31 (ii) says that A is an uniqueness set for ( 13.1ft . We recall that for the single 
equation F(x,Du) = f(x), where F, f satisfy ( I3.3l) -( l33|) . the uniqueness set is {x G 
: f(x) = 0} (see Fathi [12J ) . Notice that A maybe empty so we have automatically 
comparison (but the existence of solutions may fail). When A is not empty, it is enough to 
assume Ui < Vi for one i (this is a consequence of the irreducibility of the coupling matrix). 

Before giving an existence result for (13. ip . we prove Lipschitz regularity of subsolutions. 

Lemma 3.5. Assume that (12. ip and (I3.3p - (l3.5p hold. Let u G USC(T N ) be a bounded 
viscosity subsolution to ( 13. ip . Then u is Lipschitz continuous in T N with a constant L = 
L(Hi, ■ ■ • , H m , D, \u\oo). If (I2.3p - ()2.4p hold with Ei = E 2 = T N , then L is independent of 

Proof. From the coercitivity of the Hamiltonians Fi and [21 Lemma 2.5 p. 33], it is sufficient 
to prove that ui is a viscosity subsolution of Fi(x, Dui) < C in T . We have 

in 

Fi(x,Dui) < \djj(x)\\uj(x)\ + fj(x), 

which gives the result with a Lipschitz constant depending on Hi, ■ • ■ , H m , |D|oo, |w|oo- 

Now, if (I2.3l) - (l2.4p hold in T , then, from Lemma 12.61 (i), there exists a continuous 
function A : — )• R m , A > 0, such that D(x) T A(x) = for all x G T N . By multiplying 
Equations ( 14. 2 p by Ai(x) and summing for i — 1, . . . , m, we obtain 

m mm 

(3.21) Mx)Fi(x, Dm) + H x ) d d x ) u j = A i( x )fi( x )- 

i=l i , j = 1 i=l 

We have 

m m / m 

]C M^dijix)^ = Y ( Yl A i(%)dij(x 

i,j=l j=l \i=l 

since D(x) T A(x) = 0. It follows from (13T2T]) that 

m m 

} Aj(x)Fj(x, Duj) < \Ajfi\og, 

i=l i=l 

By the compactness of T N and the continuity of A, there exists rj = rj(D) > such that 
Aj > rj on T N for all i. It completes the proof. □ 

To state an existence result with prescribed values on A, we need to introduce some 
definitions of Fathi and Siconolfi [13] . Define, for every x G T , p G R , 

(3.22) F(x,p) = max Fi(x,p) and f(x) = min fi(x) 

Ki<m Ki<m 
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and set 

S(y,x) = max{u(x) : u subsolution of F(x,Du) < f(x) on with u(y) = 0}. 

Proposition 3.6. Assume (j2TTp . (l2Tijl with E 2 = T N , (JUS} -(ESJ . 

(i) (Classical case) If ( \3.8\i holds, then there exists a unique continuous viscosity solu- 
tion of (Grp. 

(ii) (Degenerate case) Suppose that (12 .3p /io/ds toit/j ^ = and T ^ 0. For an?/ 
continuous function g : J 7 — >■ M. satisfying 

E Ai(x)J - <?(y) f £ Ai(y) J < %, x), 
t/iere exists a unique continuous viscosity solution u of (13. ip siic/i t/iat 
(3.24) ^A^xH(x) = #(x) xGJ* 7 , 



where the continuous function A : T — >• M m , A > 0, is given by Lemma \2. 61 

Remark 3.7. The assumption (I3.23|) can be seen as a compatibility condition. We cannot 
prescribe any function g on A. Indeed, for instance, if Aj = 1 for all i and g has a large 
Lipschitz constant compared to the one given by Lemma I3.5[ then it is straightforward to 
see that it is not possible to build a solution u satisfying ( I3.24j) . 

Proof. The proof of the existence of a solution is based on Perron's method. We start by 
building subsolutions and supersolutions. 

From (13 .4p . (I3.5p and (12. ip . we obtain that ipc = (C, . . . , C) is a subsolution of (13. ip for 
every nonpositive constant C < 0. This subsolution is suitable in the case (i). 

In the case (ii), we need to build a subsolution which satisfies (I3.24p . which is more 
tricky. Note that F and / given by (I3.22|) still satisfy (I3.3p - (l3.5p . Since the compatibility 
condition (I3.23P holds, we can use the result of [131 Prop. 4.7]: there exists a subsolution 
ip of 

F(x, Dip) — f(x), xeT N with ij(x) = J!^ onJT. 

Then, the following computation shows that }&_ := (ip, • • ■ , ip) is a subsolution of (13. ip such 
that (137241 holds: recalling 1123]) . for all x G 

m m 
3=1 3=1 

Now we turn to the construction of a supersolution. Under assumption (13.81) . we can 
use ipc again with a suitable choice of C > since, for all i, 

m / m \ 

F i {x,D{tp c ) i {x)) + Y,d ij {x){iP c ) l {x) = Fi(x,0) + [J2 d »( x ) C > nC 

3=1 \3=1 ) 
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where 



by (13. 8p . It then suffices to choose 
(3.25) C > r]- 1 max |/, 



Ki<m 



i oo ■ 



In the second case, since J 7 ^ 0, we may define dj^(x) = dist(x, J 7 ). Choose C7 as in 
(I3.25P with rj = 1. By coercivity of Fj (see ( I3.4p ). there exists C" > such that, for all 
X G T w ,pG if |p| > C, then F;(x,p) > C for all i. We claim that \I> = . . . 
with if) = C'djr + C, is a viscosity supersolution of the stationary problem. Indeed, let 
i G {1, • • • , m} and let ip be a C 1 function such that if) — tp achieves a minimum at x$ ^ J 7 . 
In T N \ J 7 , it is well-known that \Ddj^\ = 1 in the viscosity sense. Since djr+C/C — <p/C 
achieves a minimum at xo, we get \D<p(xo)\ > C It follows that 

Fi(x , Dcp(x )) + (^2d i:j (x )j if>(x ) >C> fi(x ) 

since both Y^T=i^ij( x o) an d ^(^o) are nonnegative. If x G J 7 , then fi(x ) vanishes. Since 
Fi > 0, the supersolution inequality obviously holds on J 7 . The claim is proved. 

Then, we apply the extension of Perron's method to systems, see [U)l [T6] . Using the 
comparison principle 13.31 and following readily the proof of [TQl Prop. 2.1], we obtain that 
the supremum of subsolutions which are less than if>c (resp. is a solution in the case 
(i) (resp. (ii)). From Lemma [3.51 the subsolutions of (13. ip are Lipschitz continuous with 
a constant L depending only on Hi, ■ • ■ , H m and D. It follows that the supremum is still 
Lipschitz continuous. In the case of (ii), note that the supremum still satisfies ( I3.24p . □ 

Remark 3.8. Under the assumptions (12.11) . (I3.3l) - (l3.5p there always exists a subsolution. 
The assumption J 7 ^ is needed to build a supersolution when for instance Pj = for 
all i. Notice that, in the case (i) of Proposition 13.61 we do not need to assume ( I3.5p . the 
/i's may be any continuous functions in T^. 



4. The ergodic problem 

In this section, we study the solutions of (13. ip with an ergodic constant, that is: 

in 

(4.1) Hi(x, Dvi) + dij{x) v j = d x eT N , I <i <m, 

3=1 

where Hi is given by (13. 2p . When (13. 8p holds, then, see Remark |3~8| for any c = (ci, . . . , c m ) 
there is a unique viscosity solution v G C(T ). Hence we concentrate on the case T>i not 
empty for some % and we consider the ergodic approximation to (14. ip : for A G (0, 1), let 
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v x = (v x , . . . , t>^J be the solution of 

m 

(4.2) Xvi + Hi(x, Dvi) + dij(x) v j = x eT N , 1 <i <m. 

j'=i 

Lemma 4.1. Assume ( \2.1h . ( 12.4ft i?2 — and (13 . 3 [) ( T3T5T) . Then there exist a unique 
viscosity solution v x of ( 14.21) and some constants Co, M > independent of X such that v x 
is Lipschitz continuous with constant Cq and 



, M 

(4.3) < v x < — and 

X 



^ diiV; 



A 



< M, i = l,...,m. 



Proof. We first observe that the system (14. 2 p satisfies the assumption (13. 8p for all A > so 
Theorem 13 . 3 1 and Proposition 13.61 (classical case) hold. Hence there exists a unique solution 
v x . Moreover, since u = (AT/A, . . . , M/A), u = (-M/A, . . . , -M/A), where 

M > sup sup |Fi(x,0)| + \fi{x)\, 

l<i<m x ef N 

are, respectively, a super and a subsolution of ( 14. 2p . we have 

(4.4) -y<^ A <y i = l,...,m. 

In fact, in our case where Hi(x,p) = Fi(x,p) — fi(x) with > and Fi(x, 0) = 0, we have 
that (0, . . . , 0) is a subsolution and therefore we obtain the more precise estimate 

(4.5) 0<^ A i = l,...,m. 

We want to prove that the v x, s are Lipschitz continuous uniformly with respect to A. 
We argue as in the second part of the proof of Lemma 13.51 using now Lemma 12.61 (ii) with 
Ei = (/) and E 2 = T , since (I2.3P is not assumed here. Equality (I3.2ip is replaced with 

mm m m 

\J2A t {x)v x + J2A t {x)Fi{x,Dv x ) + H^)di 3 {x)v x = ^A i {x)f i {x) 

i=l i=l *J=1 i=l 

and 



m I rn 



i=l 3=1 \i=l J 

since D(x) T A(x) > and (14 .5p holds. We then conclude as in Lemma 13.51 that v x is 
Lipschitz continuous with some constant Co = Cq(Hi, . . . , H m , D). 

Finally, since for all i, Xv x and Hi(x,Dv x ) are bounded independently of A in (14.21) . it 
is true also for J2jLi dijV X . □ 

The next theorem gives a first set of assumptions under which we may solve (14.11) . 
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Theorem 4.2. We assume (j2TT]) . ( jg~jj) tuit/j £ 2 = T N , ( l3~3j) - ([3~5]) and 

in 

(4.6) 7={xeT N :^/ 4 (x) = O}^0. 

i=l 

Lei x* G J 7 . //f A i/ie solution of (14 .2p . t/ien ; to extract some subsequence as A — > 0, 

— Ar A — > c = (ci, • • • , c m ) G M. m , 

v x - v x (x*) -+v= (vi, ...,v m )in C(T N ) 

and (c, v) G M m x C(T JV ) zs solution to (14. ip wrat/i u Lipschitz continuous and c G ker .D(x) 
/or a// x. Moreover 

(4.7) Ui(sc) = /or all x £ J 7 , 1 <i < m, 

(4.8) Cj = /or alll<i<m, 

and c = (0, . . . , 0) is the unique constant vector in ker D(x), for all x G T N , such that ( 14. ip 
/ias a solution. 

Proof. Fix x* G and let w x (x) = v x (x) — v x (x*). From Lemma |4.1[ w x is Lipschitz 
continuous and bounded since is bounded. From Ascoli's theorem, up to subsequences, 
there exist a constant c G M m and a Lipschitz continuous function v such that 

(4.9) - Xv x (x*) ->■ c and w A -> v in C(T Ar ) as A ->■ 0. 
Notice that v depends on x* but not c since, for any x*,y* G T , 

(4.10) \ - Xv x (x*) + Xv x (y*)\ <XC \x*-y*\ ^0 as A -»■ 0. 

Moreover, multiplying (14. 2p by A for all i and sending A — > 0, we obtain — dij(x)ci = 
whichs gives D(x)c = and therefore c G ker D(x). 

Let x G J 7 . Since Fj > and /i(x) = 0, we observe that ( 14. 2ft implies 

TO 

(4.11) Au A (x) + ^ dij{x)Vj{x) < i = l,...,m. 

By Lemma l2~6l (ii). there exists a continuous A : T N — )■ IR m , A > such that _D(x) T A(x) > 
on and, since v x (x) > by (14.51) . we obtain 

m m m / to \ 

A^ A;(x)r A (x) < A^A;(x)r A (x) + ^^ A (x) I ^ At(g)d«j(g) I < 0. 

i=l i=l j=l \i=l J 

It follows 

(4.12) Vi=0 on J 7 , i = l,...,m. 

From now on, we choose x* G J 7 . From (I4.12p . we obtain that c = (0,...,0) and v 
vanishes on J 7 . Observe that w x is a solution of the system 

m m 

Xw x + Hi{x, Dw x ) + dij(x)w x (x) + Y dij{x)v x {x*) =0 in T N , 1 <i <m, 

i=i i=i 
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and that the last term in the left-hand side is because of ( 14.12)) . By ( 14. 9 p and the stability 
for viscosity solutions as A — » 0, we conclude that the couple ((0, . . . , 0), v) is a solution of 
the system ( 14. ip . 

Suppose that (c,v) and (c, v) are two solutions of ( 14. ip with c, c G kerD(x) for all x. 
Define w(x, t) = v(x) — ct and w(x, t) = v(x) — ct. Since c, c G kerD(x), we have that w 
and w are solutions of (15. ip with initial conditions v and v respectively. By comparison 
(see Proposition 15. ip . we get that, for all x G T , t > and 1 < % < m, 

Vi(x) — Vi(x) + (q — Ci)t < max sup {y ,■ — v 3 ) + . 

l<j<m t jv 

Therefore q < q. Exchanging the role of v and v, we obtain that c = c. □ 

We give another case where we can solve the ergodic problem f 14 .11) . In particular, note 
that T may be empty. 

Theorem 4.3. We assume that 

(4.13) D does not depend on x 

and that ( I2.ip . ( 12. 3p . (I2.4p and ( I3.3p - (l3.5p hold. Then, there is at least one solution 
(c,v) G lR m x C(T N ) to ( 14. ip with v Lipschitz continuous, c = (ci,...,Ci) is unique in 
ker D and 



m mm 

' "(•<■) 



(4.14) ^ A, ,nin /,(,■) ^ ~ c iE A * ^ ^ n E A ^ 



i=l i=l j=l 



where the constant vector A > is given by Lemma l27b] (i). 

Proof. Let v A be the solution of ( 14. 2 p and fix any x* G T^. We argue as in the proof of 
Theorem 14.21 From Lemma 14.11 and Ascoli's theorem, there exist c = (ci, . . . , c m ) G M m 
and f G C(T N ) such that, up to extract subsequences, for i — 1, . . . , m, 

\v?(x*) ->■ and - ^ A (x*) ->■ in C(T iV ), as A -> 0. 

Notice that c, does not depend on the choice of x*, (see (14.101) ). and c G kerD. We write 



(4.15) Xvf + Hi(x, D{v* - v?{x*))) + E ^(^ - v^x*)) + E dy^V) = in T N , 

3=1 3=1 

From (14.31) . we obtain that some subsequences of both Xv^(x*) and Y^jLi dijVj(x*) converge. 
We call the second limit pi = Pi(x*). Using the positive vector A given by Lemma [2.61 (i), 
we have 

mm m / m \ 

E^e^V) = E E A ^ = °- 

8=1 j=l j=l \i=l J 

Passing to the limit in the above formula, it follows (A, p) = 0, where (•, •) is the standard 
inner product. Since D T A = and the rank of D is m — 1, we get that the image imD 
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of D is A- 1 . Thus p G imD and there exists p G M. m such that Dp = p. We then use the 
stability result for viscosity solutions and pass to the limit in (I4.15p . We get 

m m 

(4.16) Hi(x, Dvi) + dijVj(x) + dijPj = Q in T N , 1 < i < m. 

j=i j=i 

Then (c, v (•) + p) is solution to (14.11) . The function v = v + p depends on x* but not c. 

From Lemma [2.61 the kernel of D is the line spanned by (1, . . . , 1). Thus, any c G ker D 
has the form (c\, . . . , c\). The proof of uniqueness of c is the same as the one in Theorem 14 .21 

It remains to prove (14.141) . We use again the vector A given by Lemma [2.61 (i). On the 
one hand, multiplying (14.11) by Aj and summing them for % = 1, . . . , m, we obtain 



(4.17) O^J^Aif^ + aJ^Ai, xeT 1 



iVj, xt J 

i=l i=l 

On the other hand, let X{ G be a minimum of the continuous function Ui and set 
Ui = Ui(xi). At Xi, the equation (14. ip reads 

m m 

(4.18) ^ d ii u i ^ ^2 d v u i( x i) = fi( x i) + c i> 

i=i j=i 

since Uj < Uj(xi) and dij < for i ^ j. Multiplying (14.181) by Aj and summing them for 
i = 1, . . . , m, we get 

m m m m 

= U J Yl Aidi i - Yl A i(fi( x i) + ci) > ^ Ai(min /< + c x ). 

j'=l i=l i=l i=l 

Combining the previous inequality with (14.171) . we finally obtain (I4.14p . □ 
Remark 4.4. 

(1) The inequality (I4.14p gives a characterization of c when all the /j's achieve the same 
minimum at the same point. 

(2) It would be interesting to prove Theorem 14.31 when the d^'s depend on x. The 
difficulty is that the p^s in the proof are now functions on x and we do not obtain 
anymore a solution of (14. ip . 

Example 4.5. Consider the system 

\Dv l \ +V 1 -v 2 = /i + ci inT^, 
\Dv 2 \ - v 1 + v 2 = f 2 + c 2 inT N , 

with fi = a, f 2 = b, a,b > 0. This system satisfies all the assumptions of Theorem 14.21 
with the exception of (14.61) since fi + f 2 = a + b > 0. However, all the assumptions of 
Theorem 14.31 hold and therefore we can solve (I4.19p . For instance, we can exhibit constant 
solutions (c, v) with c\ = c 2 . An easy computation gives c\ = — (a + b)/2 and all constants 
v = (vi,v 2 ) satisfying v\ — v 2 = (a — b)/2 are suitable. Notice that we can solve (14. 19p 
even in some cases where Theorem 13.31 and Proposition 13.61 do not apply. Indeed, (I4.19P 



(4.19) 
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corresponds to the degenerate case of Theorem 13.31 and either fi + C\ or f 2 + C\ is negative 
and ( 13. 5 p does not hold. 

5. Large time behavior 

We are interested in the long-time behavior of the evolutive system 

d m 
(51) ^ -^ + H i (x,Du l ) + Y,d ij (x)u j = (x,t) ET N x (0,+oo), 

Ui(x, 0) = u i (x) x G T N , i = l,---m, 

where Hi is of the form (13. 2p and 

(5.2) u 0t i is continuous and 1-periodic. 

We start giving some auxiliary results for the evolutive problem. The following two propo- 
sitions come from [7J, where homogenization of a general class of monotone systems which 
includes in particular the weakly coupled system (15. ip . is studied. Let us mention that 
Proposition 15.11 is established in [7] under the additional assumption 

There exists a modulus of continuity oj such that, 

\Fi(x,p) - F t (y,p)\ < w((l + \p\)\x - y\) for all x, y G T N , p G R N , i = 1, . . . , m, 

but a careful examination of the proof shows that we do not need it. The coercivity of the 
FiS is enough (see the proof of Theorem 13. 3p . 

Proposition 5.1. Assume flZTJ and (13T2D - fl3"3]) . 

(i) If Uq, Vq are two initial datas satisfying (15.21) and u, v are respectively a viscosity 
subsolution and a supersolution of (15.11) . then for any t > 0, 

(5.3) max sup t) — Vi(-, t)) < max sup 0) — v 0)) + . 

l<i<m -jpjv l<i<m rmjv 

(ii) For any uq satisfying (15. 2p . there exists a unique continuous viscosity solution u of 

A crucial step in the study of the large-time behavior of equations or systems is to 
obtain compactness properties of the sequence (u(-,t))t>a- As for a single Hamilton- Jacobi 
equation, it relies on the coercitivity of the Hamiltonians. 

Proposition 5.2. Under the assumptions of Theorem \4-S\ or Theorem \4-3\ let Uq G 

W 1,00 (T ) and u be the solution of (15.11) with initial datum Uq. Then 

(5.4) \u{x,t) + ct\ < C x G T N , t G [0, oo), 

(5.5) \u(x,t) - u(y,s)\ < L(\x - y\ + \t - s\) x,y G T^, t, s G [0, oo), 

with C, L independent of time, where c is the ergodic constant given in Theorem \4-2\ or \4^ 
It follows that 



t 



— > —Ci uniformly in T as t ^ +oo, z = 1, . . . , m. 
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Remark 5.3. Given u satisfying (|5.2|) . set S(t)uo = u(x,t) for t > where u is the 
solution of (15. II) with initial datum w . Then it is easy to see that S(-) generates a nonlinear, 
monotone, nonexpansive semigroup in C(T N ; M m ). Under the assumptions of Theorem 14.21 
c = (0, . . . , 0), so u is in L°°(T N x [0, +oo)). It follows that {S(t)u , t > 0} is relatively 
compact in C(T N ). Therefore, the cu-limit set of an initial datum m with respect to the 
semigroup S(t), 

(5.6) oj(uq) = {ip = (ipx, . . . , il> m ) £ C(T N ) : 3t n — > oo such that lim S(t n )u = ip}. 
is nonempty. 

Proof. The proof is based on the existence of a solution to the ergodic problem which is 
used to estimate u. It is classical but we provide the proof for reader's convenience. 

Let (c, v ) be the solution of (14.11) given by Theorem 14.21 or 1431 Since c £ kerD, w(x, t) = 
v(x) — ct — \uo\oo — |f|oo and w(x,t) = v(x) — ct + |wo|oo + Moo are respectively viscosity 
subsolution and supersolution to (15. ip . By comparison (I5.3p . it follows that 

(5.7) v(x) - |n |oo - Moo < u(x,t) + ct < v(x) + |u |oo + \v\oo (x,t) £ x [0, oo), 
which proves (15 .4p . If we define 



C := sup 



Hi (x, p) + ^d. 



: x £ R N , \r\ < |« |oo, |p| < I-DmoU, 1 < * < m 



it is easy to see that v ± (x,t) = (u ,i(x) ± Ct, ■ ■ ■ ,uo im (x) ± Ct) are viscosity subsolution 
and supersolution of (15.11) . By Proposition 15. 1[ it follows 

(5.8) v~ < u < v + inJ N x [0, +oo). 

Let h > and note that, since the H^s are independent of t, u(-,- + h) is still a solution 
of (15. ip with initial data «(•, h). By (15.31) and (15. 8p . we get for all z = 1, . . . ,m, (x,t) £ 
x [0,+oo), 

Mj(a^, t + h) — Ui(x, t) < max sup (uj(-, h) — u j) + < Ch, 

l<j<m j N 

and therefore Ui is Lipschitz continuous with respect to t for every x with 

dui 



< C. 



Ot 

with C is independent of t. From (15. ip and (15. 7p . we obtain, in the viscosity sense, 

Fi(x, Dm) < C (x, t) <ET N x [0, +oo). 

It follows from Lemma 13751 that is Lipschitz continuous in x for every t with \Dui\oc < Li 
(with Li independent of t). □ 

We now state and prove our convergence result in the case of systems, under the as- 
sumptions of Theorem 14.21 
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Theorem 5.4. Assume (EH), (J23J) witfi ^2 = and fkT3|) -f l33|) . Suppose that A^Q. 
For every uq satisfying (I5.2p . there exists a solution to ( 13. ip suc/i t/iot t/ie solution u 
of ( 15. ip wift initial datum uq satisfies 

lim |w(-,t) - Mooloo = 0. 

t— >oo 

Moreover (uoo)i = ("Uoo)j on .4 /or a// 2, j. 
Proof. The proof is divided in several steps. 

Step 1. Reduction to Lipschitz initial datas. Given uq satisfying (15. 2p . set S(t)uo = u(x,t). 
Since the semigroup S(t) is nonexpansive, see Remark [5731 it is sufficient to show the result 
for u G W 1 ' 00 ^). 

Step 2. A positive linear combination of the Ui 's is nonincreasing on A. Since ( 12 .3p holds 
with Ei = A, from ( 12. 4 p and Lemma 12.61 there exists a positive continuous function A = 
(Ai, . . . , A m ) : A — > R m such that D(x) T A(x) = on A. By multiplying the equations ( 15 .ip 
by Aj > and summing for i — 1, . . . , m, we obtain 

(5.9) — (^A i u i )+^A iJ F i (:r, J Du;) + ^ I X) A ^ ) u j = J2 Ai h in -4 x (0, +00), 

i=l i=l j=l \i=l / i=l 

in the viscosity sense. Moreover, since u is Lipschitz continuous (Proposition I5.2p . ( 15. 9 p 
holds almost everywhere. Formally, since Fi > 0, D(x) T A(x) = and fi(x) = for x £ A, 
it follows that 

d m 

— (^A^)<0 in Ax (0,+oo), 
i=i 

and X)I=i A-iUi(-, x) is nonincreasing in A. More precisely, we have: 
Lemma 5.5. There exists a Lipschitz continuous : A — > R snc/i t/iat 

(5.10) ^^AjUj(-,t) 4 uniformly on A as t — >• +00. 

8=1 

The proof is postponed. 

Sfep 5. Uniform convergence of a subsequence of u. Notice that the assumptions of The- 
orem 14.21 hold. It follows that there exists a solution to the ergodic problem (14.11) and 
therefore, from Proposition 15.21 (see also Remark 15.31) . (u(-,t)) t >o is relatively compact in 
C(T N ) and there exists a sequence t n — > +00 such that u(-,t n ) converges uniformly on 
as n — > +00. From ( 15. 3ft . we obtain that for all n, q G N, 

max sup \ui(-,t n + ■) - Ui(-,t q + -)\ < max sup \ui(-,t n ) - Ui(-,t q )\ 



l<j<m T jv x[0j+oo) ±^m T ^ 



and therefore («(•, t„ + •))„, is a Cauchy sequence in iy 1 ' 00 (T 7V x [0, +00)). Thus it converges 
uniformly to some function w G W 1,00 (T N x [0, +00)). By the stability of viscosity solutions, 
w is a viscosity solution of (15.11) (see [H [21 [10] for details). 
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Step 4- Uniform convergence of the sequence w(-,t) on A. The reason of introducing w in 
Step 3 is that, from Lemma 15. 5^ we have 

m 

(5.11) y^AjWi(-,t) = <j> on A for all t G [0, +oo). 

i=i 

Surprisingly, this is enough to prove the convergence of each Wi on A: 

Lemma 5.6. The function w(-,t) converges uniformly on A to a function Mqo(-) which is 
Lipschitz continuous on A. 

The complete proof is postponed, we only outline the main ideas here. At first, from (15.111) . 

we get 

d m 

— (J2 A i W i)=° m A X (0,+00). 

i=l 

Then, writing (15. 9p for w and using in addition D(x) T A(x) = and fi = on A we obtain 

m 

y^Aji^x, D-Wj) = in A x (0, +oo). 

i=i 

Thus, for all i, Fi(x,Dwi) = on A x (0,+oo). It follows that, for fixed x G A, the 
system (15.11) reduces to a linear differential system in R m , 

dw 

—(x,t) + D(x)w(x,t) = iG 0,+oo . 
at 

The solution is given by 

w(x, t) = exp(—tD(x))w(x,0). 

Since D is an irreducible M-matrix, it has as a simple eigenvalue and all the other 
eigenvalues have positive real part. It follows that both exp(— tD(x)) and w(x,t) converge 
as t — >■ +oo. 

Step 5. Convergence of the whole sequence (w(-,t)) t > on T N . Since w is bounded in 
x [0, +oo), we can introduce the relaxed half-limits 

(5.12) w(x) = (limsup * w)(x) = lim sup{w(y, s) : y G B(x, 1/t), s > t}, 
w(x) = (liminf * w)(x) = lim inf {w(y, s) : y G B(x, 1/t), s > t}, 

t—>+oo t— >+oo 

where the half-limits are taken componentwise. By the stability of viscosity solutions, w 
and w are respectively a sub and a supersolution of (14.11) with c = 0. From Step 4, we 
have 

Wi = w_ i = (moo)?, on A for alH = 1, . . . , m. 

It follows that 

m m 

(5.13) A i w i = ^2 Ai — « = ^ x e a. 

i=l i=l 
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Applying Theorem 13.31 (degenerate case), thanks to (15.131) . we obtain w < w hi ^ N an d 
therefore w = w =: Uoo is the unique continuous viscosity solution of ( 13. ip such that 
Y^hLi ^~i( u oo)i = on A. This gives the convergence of w(-,t) to Woo in C(T N ) and this 
latter function is Lipschitz continuous. 

Step 6. Convergence of (u(-,t)) t >o- It remains to prove that u(-,t) converges to as t — > 
+oo. We proceed as in Since u and w are both solutions of ( 15. ip . from Proposition 15. 11 
we have 

max sup |Wi(-,t n + t) - < max sup |u;(-,t„) - Wi(-,0)\ = o n (l), 

l<i<m qp]\r l<i<m j,N 

where o„(l) — >■ as n — > +oo since u(-,t n + •) converges uniformly to It follows 

that, for all 1 < i < in, x e and t > 0, 

t) - o n (l) < £ n + 1) < w(x, t) + o n (l). 

Taking the relaxed half-limits in the above inequality, we obtain 



and 



^oo(^) — o n (l) = (Km inf *w) (x) — o n (l) < (lim inf (x) 

t— !-+oo t— >+oo 



(limsup *u)(x) < (limsup *w)(x) + o n (l) = Moo(x) + o n (l) 

t— >+oo t— !-+oo 



Sending n to +oo implies 

(liminf = (limsup *u)(x) = u^x) 

which proves the uniform convergence of u(-,t) to Mqo as t — > +oo. 

Step 7. All the (-Uoo)i ' s are egitaZ on A. Using the previous arguments, it is straightforward 
to see that D(x)uoa(x) < for all x G A. From A2.3I) . it follows that itoo(x) £ ker _D(x) and 
therefore, from Lemma [2.61 (woo)i = (uoa)j on A for all i, j. □ 

Remark 5.7. 

(1) Let us mention that there is an easy version of the convergence theorem when (12.11) . 
(I3.3p - (I3.5I) and (13.81) holds. In this case, ( 14.11) has a unique Lipschitz continuous 
solution u with c = 0. The solution of ( 15. ip is bounded and we define the relaxed 
half-limits as in ( 15. 12ft . The classical case of Theorem 13.31 yields u = u =: and 
gives the convergence. Actually, in this case, Woo = 0. 

(2) Assuming A means that all the /j's are zero at least at a common point 
(see ([alD and Remark ED}. If (Q holds with E 1 = T N (i.e., if = 

in (13. 7p ). then we can replace this assumption with 

(5.14) 3/ > such that min/j = / and (| argmin /j ^ 0. 

l<i<m 

Indeed, using (12.31) . we recover the framework of Theorem 15.41 by replacing Ui(x,t) 
with Ui(x,t) = u(x,t) — ft and fi with /; - / > 0. In a future work, we aim at 
studying the large time behavior of the system (15.11) when A = 0. 



24 FABIO CAMILLI, OLIVIER LEY, PAOLA LORETI AND VINH DUC NGUYEN 



(3) With the same kind of arguments as in Lemma 15.51 we can prove that 

(5.15) max Uj(x,t) j. <fi uniformly on A as t — )■ +oo. 

l<j<m 

The rough idea is that, if Ui(x,t) = maxi< j< m Uj(x,t) for (x,t), then 

m 

dijUj(x, t) > 

i=i 

(9it ■ 

and therefore, using the zth equation, we get -—^(x,t) < on yl. Note that 

ot 

Lemma 15.51 and (I5.15P give an alternative proof for the convergence theorem 15.41 
when m = 2 since these two convergences are enough to imply the convergence of 
u\ and «2 on A. This approach is used in [22] to obtain the convergence result for 
two equations in a very similar setting. 

(4) Formula (15. lip means that every element ip of the a;- limit set u(uo) given by (15. 6 ft 
satisfies 

m 

(5.16) ^A;V>i = on A. 

1=1 

Moreover, since uj(uo) is positively invariant for the semigroup, for every ip e oj(uq) 
the restriction of S(t)tp to J 7 is constant in time. 

Example 5.8. Extensions to Theorem 15 .4! are not easy to obtain. When the assumptions 
of the previous theorem are not satisfied, the convergence is not always true. The following 
example is similar to the one in [3]. Consider 

dui 
~dt 

(5.17) < du2 

dt 

ui(x, 0) = m 2 (x, 0) = sin(x). 

If a, ft > 1, then the unique solution of (I5.17P is u(x,t) = (sin(x — t),sin(x — t)) which 
clearly does not converge as t — > oo. In this case, (13.31) . (13.51) . (12. 3p and (12. 4p hold but (13. 4 p 
fails and ^4 = 0. Moreover, notice that the assumptions of Theorem 14.31 hold. The ergodic 
problem has a solution (c, v ) with c = (0, 0) and v = (C, C) where C is any constant. 

Proof of Lemma 15.51 The proof is inspired from the corresponding one for a scalar equation 
in |25] • We set 

m m m / m \ 

U = ^ Kui and $ = ^ AJi - ^ I ^ A^^- J 

i=l i=l j=l \i=l / 

and cj(-) is a modulus of continuity for $(•, t) on the compact set T^. Note that the modulus 
is independent of t because of (15. 5p . Let x G A and consider the cube B e (x) = [x—e, x+e] N 



+ \Du\ + a\ + u\ — U2 = ct in R x (0, oo) 
\Du 2 + ft\ - Ui + u 2 = ft inlx (0,oo) 
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for e > 0. Noticing that, for all t > 0, Q(x,t) = by the very definition of A and A, we 
have 

— [U(y,t + h)-U(y,t)]dy = — / — (s,y)dsdy 

e J B E (x) e J B e (x)x[t,t+h] 0t 

< — / $(y,s)cfeA/ 

Sending e — > and using the continuity of {/, we get U(x,t + h) < U(x, t) for any /i > 0. □ 

Proof of Lemma \5.6[ Arguing as in Step 2 of the proof of Theorem I5.4[ since w is solution 
to (15.11) . we have 



rn I rn 



A i w *) + Y A ^( x > Dw i) + Y [ Y Aid v ) w 3 = Y Ai fc 

i=l 8=1 j=l \i=l J i=l 



almost everywhere in x (0, +oo). 
From now on, we fix x G A. Setting 



m I rn 



w = y^ A m, ^ = Y AiF ^' Dw ^ and $ = Y A *f* -E E Aid 

8=1 i=l i=l j'=l \i=l 

and integrating as in the proof of Lemma 15.51 we have 
(5.18) \\ [W(y,t + h)-W(y,t))dy 

1 lW -(y,s)dsdy 



£Tl I B e (x)x[t,t+h] ®t 



W $(y,s)dsdy - \ [ ^(y,s)dsdy. 

e J B s (x)x[t,t+h] e J B e (x)x[t,t+h] 



As in Lemma [5.51 since x G A, 

1 

e' 



§(y,s)dsdy = o e (l) 

B £ (x)x[t,t+h] 



where o e (l) — > as e — > uniformly with respect to £. Since does not depend on t on 
A from (15.111) . we have, for all y G B £ (x), 

\W(y, t + h)- W(y, t) | < * + h) - W(x, t + h)\ + \W(x, t) - W(y, t) | = o e (l), 

using the uniform continuity of the d^s on and the Lipschitz continuity of the w^s 
with respect to y G T N uniformly in t. It follows from (15. 18ft that 

$(y,s)dsdy = o e (l) 

B £ (2')x[t,t+ft.] 
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and therefore, for all 1 < i < m, using the uniform continuity of A, on T N and the 
boundedeness of Fi(y, Dwi), we have 

(5.19) \ [ F l (y,Dw l (y,s))dsdy = o £ (l). 

£ J B e {x)x[t,t+h] 

Let 1 < i < m and consider the ith equation: 

duo- m 

+ Fi(y, Dwi) + d-ijWj = fi almost everywhere in x (0,+oo). 



dt 



Integrating as above around x G A, we get 

\l (Wi{y,t + h) -Wi(y,t))dy+ — I S^d^jdsdy 

8 JB £ (x) £ J B E (x) x [t,t+h] j=l 

— / -^dsdy+— ^d ijWj dsdy 

e J B e (x)x[t,t+h] 01 £ J B e (x)x[t,t+h] j =1 

\\ fi(y)dsdy-^[ Fi(y,Dwi(y,s))dsdy 

£ J BJx)x\t,t+h] £ J BJx)x\t,t+h\ 



£ 



from (15. 191) and since x G A. Using the continuity of Wi and dij and sending e to 0, we get, 
for all t, h > 0, 



i>t+h "- 

Wi(x, t + h) — Wi(x, t) + / dij(x)ujj(x, s)ds = 0, 1 < z < m. 

^ 3=1 

Recalling that t \-t w(x,t) is Lipschitz continuous, we obtain that w is solution to the 
linear differential system 

dw 

~q£\ x i t) + D{x)w(x, t) — almost everywhere for t G (0, +oo). 

The unique solution of this system is 

w(x,t) — exp(— tD(x))w(x, 0). 

Since D(x) is an irreducible M-matrix, is a simple eigenvalue and all the nonzero eigen- 
values have a positive real part. It follows that there exists a matrix A(x) such that 
exp(— tD(x)) = A(x) + 0(e~ rt ) where r > is the smallest real part of the nonzero eigen- 
values. Therefore, 

w(x,t) — > A(x)w(x, 0) = lim A(x)u(x, t n ) =: u^x). 

t— >+oo n— >+oo 

Since w G W 1,00 (T N x [0, +oo)), we obtain that Uoo G W 1,oc (T N ). □ 



(6.1) 
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6. The control-theoretic interpretation 

At least when the coefficients dij of the coupling matrix D are constant, we can give 
an interpretation of our system of Hamilton- Jacobi equations (15. ip in terms of optimal 
control of hybrid systems with pathwise deterministic trajectories with random switching. 
We do not give the proofs here, we refer the readers to Fleming and Zhang [14J, Yong and 
Zhou [28] and the references therein. 

Consider the controlled random evolution process (X t , v t ) with dynamics 

X t = b Ut (X u a t ), £>0, 
(X ,v ) = (x,i)eT N x{l,...,m}, 

where the control law a : [0, oo) — > A is a measurable function (A is a compact subset of 
some metric space), b { G L°°(T 7V x A; R N ), satisfies 

(6.2) \bi(x, a) — bi(y, a)\ < C\x — y\, x, y G T , a G A, 1 < i < m. 

For every a t and matrix of probability transition G = satisfying ^j^jij = 1 for 

i 7^ j and ju = —1, there exists a solution (X t , vA, where X t : [0, 00) — > T N is piecewise C 1 
and u(t) is a continuous-time Markov chain with state space {1, . . . ,m} and probability 
transitions given by 

P{^+At =j\v t = i} = nAt + °( At ) 

for j ^ i. 

We introduce the value functions of the optimal control problems 

(6.3) Ui{x,t) = inf E xi { f Us (X s )ds + u ^ t { x t)}, i = l,...m, 

<HeL°°([0,t],A) J 

where denote the expectation of a trajectory starting at x in the mode i, fi, Uq^ : 
— > ]R are continuous and fi > 0. 
It is possible to show that the following dynamic programming principle holds: 

Ui(x,t)= inf E Xji { f f„ s (X s )ds + u Uh (X h ,t-h)} < h < t. 

a t £L°°({0,t],A) Jo 

Then the functions Ui satisfy the system 

+ sup-{bi(x,a),Dui) + y2 r Jij{u i - Uj) = fi (x,t) ET N x (0,+oo), 
Ot aeA ... i — 1, • • • m, 

Ui(x, 0) = Uo t i(x) x G T N , 

which has the form (15. ip by setting Fi(x,p) = sup aeA —(bi(x,a),p) and da = = 1 

and d^ = —jij for j 7^ i. 

The assumptions (12. ip , (13. 3p and (13.51) are clearly satisfied and (13.41) holds if the following 
controllability assumption is satisfied: for every i, there exists r > such that for any 
x G T N , the ball B(0,r) is contained in co{6j(x, A)}. Moreover, r\i<i< m Vi = T N and 
A = T. 

Assuming (13. 7p . (12. 4p . we obtain that Theorem 15.41 holds. Roughly speaking, it means 
that the optimal strategy is to drive the trajectories towards a point x* of A and then not 
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to move anymore (except maybe a small time before t). This is suggested by the fact that 
all the /.j's have minimum at x* and, at such point, the running cost is 0. Now, if ( 13. 7p 
does not hold anymore, things appear to be more complicated. We hope to come back to 
this issue in a future work. 
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